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Introduction 

Before  describing  our  method,  we  first  recall  the  basic 
convex  programming  problem:  Given  a  convex  set  in  n-dimenslonal 
Euclidean  space  (in  the  following  called  constraint  set ) . 

Given  a  hyperplane  (referred  to  as  the  cost  plane )  not  inter- 
secting  the  constraint  set.  The  problem:  find  a  point  in  the 
set  such  that  the  distance  from  the  hyperplane  is  minimal 
compared  with  all  other  points  in  the  set.  Any  point  that  is 
In  the  set  but  not  necessarily  the  closest  to  the  cost  plane 
is  called  a  feasible  solution. 

Our  method  is  an  evolution-process .  We  assume  that  we 

have  an  initial  feasible  solution  y©.  The  procedure  is  to 

subject  y©  to  processes  abstracted  from  biological  evolution: 

'’mutation" ,  "mating"  and  "selection  of  the  fittest". 

« 

By  mutation  we  mean  the  following:  Given  a  point  x  on 
the  boundary  of  the  constraint  set,  we  consider  the  vector 
d  ■  y©  -  x.  The  coordinates  of  3  may  be  thought  of  as  corres¬ 
ponding  to  "genes".  We  "mutate”  d  by  adding  a  perturbation 
vector  all  of  whose  coordinates  are  zero  except  one  (we  are 
mutating  one  gene  at  a  time). 

». 
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By  "mating"  we  understand  the  following:  given  points 
x,  z  we  have  3  -  y  -  x  and  d  ■  5  -  5  as  the  corresponding 

directions.  Let  3  ■  (3„  ♦  3w)/2,  then  we  consider  the  point 
u  on  the  constraint  surface  and  the  line  with  direction  3 
through  yQ  to  be  the  "offspring"  of  the  "mated  parents", 
x ,  z . 

"Selection  of  the  fittest"  means  that  we  choose  the  vector 
whose  cost  is  smallest  from  the  family  we  generated.  That 
is  to  say,  we  choose  from  all  the  specimens  generated  the 
optimum  one.  If  this  optimum  is  an  improvement  over  the  last  one 
in  the  cycle,  we  return  for  another  one,  providing  we  have  not 
cycled  back  more  than  a  predesignated  number  of  times. 

We  will  first  describe  and  analyze  the  method  and  its 
implementation  for  linear  constraint  functions  -  linear  programming. 
Then  we  proceed  to  discuss  the  method  for  the  more  general  problem 
with  non-linear  constraints.  The  process  is  started  by  taking  as 
first  x  the  intersection  point  of  the  line  through  yQ  that  is 
perpendicular  to  the  cost  plane  (the  gradient  direction). 


I  would  like  to  thank  the  many  persons  who  were  so  generous 
with  their  help  during  all  stages  of  this  research.  In  parti¬ 
cular,  my  thanks  to  Professor  H.  J.  Bremermann  for  his  help  and 
encouragement  as  committee  chairman;  to  Professors  0.  B.  Dantzig 
and  D.  H.  Lehmer  for  their  suggestions  as  committee  members; 
to  Steven  Salaff,  who  had  many  constructive  criticisms  during 
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tive  criticisms  during  the  early  stages  of  this  work. 
Finally,  I  also  want  to  express  my  gratitude  to  the  Office 
of  Naval  Research,  without  whose  support  this  research 
would  not  have  been  possible,  and  to  C.E.I.R.,  Inc.,  who 
made  available  their  machine  on  many  occasions. 


Description  of  the  Method 


The  problem  that  we  are  trying  to  solve  Is  the  following:  We 
are  given  a  system  of  m  linear  inequalities  in  n  unknowns 
with  real  coef f icient s: 


allxl  +  a12x2  +  '  • '  +  alnxn  >  bl 
a21xl  +  a22x2  +  • '  '  +  a2nxn  i  b2 


amlxl  +  am2x2  + 


-i-  a  x  >  b 
mn  n  —  m 


These  Inequalities  shall  also  be  called  constraints .  To 
simplify  our  notation  we  shall  represent  the  constraints  in 
matrix  form: 

Ax  >  b 


where: 


A 


is  the  matrix  of  coefficients 


and 


Wo  are  also  given  a  linear  cost  function 
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We  note  that  this  J  inear  cost  function  defines  a  hyperplane  in 
n-dimensional  Euclidean  space.  Similarly  the  equations 

♦  ...  ♦  aln*n  -  bj 

also  define  hyperplanes  which  bound  the  oonvex  polyhedron.  We 
say  that  a  vector  x  ■  (x^,  ...  jX^)  is  feasible  if  Ax  <_  b.  That 
is  to  say  x  satisfies  the  constraints.  x  is  called  optimal 
if  x  is  feasible  and  for  any  other  feasible  vector  y  cx  <_  cy. 
Our  problem  Is  to  find  such  an  optimal  vector  x  ,  providing 
it  exists. 

i 

Before  we  describe  our  method  in  detail  we  will  briefly 
outline  it  in  an  intuitive  manner.  Our  me- hod  assumes  a  given 
initial  feasible  vector  from  which  we  can  starv .  Denote  this 
Vector  by  yQ,  for  t\  point  in  n-space.  .Prom  this  point  we  travel 
in  the  direction  perpendicular  to  the  cost  hyperplane  till  we 
reach  the  boundary  of  the  constraint  polyhedron.  After  this 
point,  whose  coordinate  vector  we  denote  by  x,  has  been  found, 
we  proceed  to  "shoot  a  buckshot  volley"  in  the  direction  x-yQ. 

By  "buckshot  volley"  we  understand  the  following:  Prom  a  point 
inside  the  polyhedron  we  proceed  in  several  random  trial  directions 
that  are  contained  in  a  circular  cone  of  some  given  solid  angle 
around  the  given  fixed  direction.  The  distribution  of  the  random 
directions  is  analogous  to  the  trajectories  traced  by  individual 
grains  of  a  blast  of  buck  shot.  We  then  determine  the  inter¬ 
section  points  of  the  trajectories  with  the  polyhedron.  The 
coordinate  vectors  of  these  intersection  points  are  feasible 
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The  coordinate  vectors  of  these  intersection  points  are 

feasible  vectors  since  thay  satisfy  Ax  _<  b  (v;ith  the 

equal  sign  occurring  in  at  least  one  component).  Among 

these  vectors  there  i3,  we  hope,  one  vector  x'  having  a  cost 

that  is  ’e?1*  than  the  cost  of  x  and  also  such  that  the 

n  2 

norm  of  the  difference  between  x  and  x',  i.e.  Z  (x’.-x. ) 

i-1  1  1 

is  greater  than  a  certain  e  which  we  will  accept  as  the 
smallest  change  in  vectors. 

If  the  norm  of  the  difference  is  greater  than  e  and  we  have 

not  exhausted  a  given  maximum  number  of  loops  we  then  exchange 

x'  and  x  and  shoot  another  "volley"  around  the  new  direction 

determined  by  the  new  x  and  yQ.  This  method  is  continued 

until  we  either  are  not  Improving  our  approximation  fast 

2  * 

enough,  that  is  Xfx^-x^)  <  e,  or  we  exceeded  the  maximum 
number  we  allowed  for  iterations. 

In  what  follows  we  shall  try  to  describe  the  method  we  are 
using  to  effect  the  above  mentioned  "buckshot"  technique. 


To  simplify  the  description  we  want  to  introduce  soma  further 
notation:  by  e^^  we  will  understand  the  vector  defined  by 
.  the  point  in  our  n-dimensional  Euclidean  space  that  has  a  1 


,  th 

3 

(6...  6. 


in  the  i —  coordinate  and  0's  elsewhere.  In  other  words: 

fl  if  i-J 
10  if  if) 


'i  ~  v~il'  12'  »  ~ij 

is  Kronecker's  delta. 


•*,  8^,  •••,  5ln)  where  5^ 


s 


t 


4. 


For  the  "buckshot"  effect  we  need  to  h&ve  some  dimensions  for 

the  cone  which  will  determine  how  "wide"  or  "open"  the 

buckshot  will  be.  For  this  we  read  in  two  factors  h,  2, 

a  high  and  a  low' factor  respectively.  The  factor  h  will  be 

multiplied  by  a  random  number,  uniformly  distributed  between 

0  and  1,  during  the  course  of  each  buckshot.  The  factor 

■l  n  o  n  p 

l  will  be  set  to  7  Z  (x.'-x. )  if  l  <  2  (x!-x. )  ,  to 

*i-l  11  i-1  1  1 

reduce  the  small  cone  and  increase  our  rate  of  convergence 

as  the  approximation  come3  closer  to  a  limit  point. 

#  • 

The  process  start's  as  follows:  we  generate  a  set  of  feasible 
vectors  by  modifying  the  direction  given  by  yg  and  x,  our 
initial  feasible  vector  and  our  current  best  approximation 
respectively,  by  adding  to  it: 

d  ■  yQ  -  x  +  f  e1  for  i  -  l,***,  n 

when  f  is  h  or  2,  the  high  and  low  factors  respectively. 
This  gives  us  for  each  of  the  n-dimensions  4  new  vectors  and 
3ince  we  include  x  in  the  family  we  have  4n+l  feasible 
vectors.  These  vectors,  which  we  shall  call  the  "parents", 
are  when  "pairwise  mated".  If  we  denote  by  x^  the  members 
of  the  parents  set,  J«l, • • • ,4n+l,  then  by  pairwise  mating 
we  mean  the  fol?  w ing:  We  determine  the  coordinate  vector  z 
of  the  intersection  of  the  lines  through  yQ  in  the  direction 

d  ■  yQ  -  0.5(x*^  +  x*)  where  1  <  J  <  4n+l 

1  <  k  <  4n+l  and  J  ^  k 


with  the  -boundary  of  the  constraint  polyhedron.  By  pairwise 


mating  we  thus  obtain 

^4n+l 

2 


;nu: 

t 


2n(4n+l)  vectors.  Wo  note  that  for  large 


values  of  n  thi3  method  implies  a  prohibitively  large  number 
of  operations.  To  somewhat  counteract  thl3  problem  we  have 
introduced  a  modification  which  will  enable  U3  to  3kip  over  a 
number  of  parents  in  the  "mating"  proces3.  We  have  thus  been 
able  to  analyze  some  higher  dimensional  cases. 


By  ranking  this  family  of  vectors  according  to  the  cost  we 
can  proceed  to  find  the  one  with  lowest  cost  function  value 
and  proceed  with  the  iteration  method  described  above. 

We  shall  now  give  a  description  of  how  the  method  works  in 
a  step  by  step  manner: 


1.  Given  the  initial  feasible  vector  y^,  the 
constraints  A;:  ^  b  and  the  co3t  function 

cx  »  z,  our  first  3tep  is  to  find  the  vector 
x  in  the  direction  normal  to  the  plane  defined 
by  the  cost  function.  Thi3  vector  x  now 
becomes  the  first  vector  in  our  scheme  and  the 
iteration  cycle  begins 

2.  Ue  take  the  direction  determined  by  y^t  our 
initial  feasible  vector,  and  our  current  best 
approximation  vector  x: 

d  -  y0  -  x  -  (y0  • • -#y0  -xn) 

l  n 

and  effect  our  buckshot  effect  around  this  direction. 

3.  Prom  the  family  generated  in  step  2  we  pick  the 
vector  x’  which  has  the  least  cost  and  we  evaluate 
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If  t  >  e  then  we  proceed  to  exchange  x  and  x' 
and  check  whether  this  v/as  the  last  permissible 
iteration.  We  next  proceed  to  check  if  our  running 
low  factor  for  the  buckshot  effect,  J,  i3  les3 
than  t,<  if  It  lo  then  we  3ct  £  ■  1/2  t,  otherwise 
we  leave  it  the  same.  Then,  if  we  have  not  exceeded 
the  maximum  number  of  Iterations  we  return  to  step  2. 
If  not  we  finish  this  run  by  saving  the  Information 
gathered  so  far.  On  the  other  hand  if  t  <  c  then 
we  assume  that  our  improvement  is  too  3low  and  we 
also  proceed  to  save  the  information  and  exit. 


We  have  so  far  repeatedly  mentioned  that  we  travel  along  a  given 
direction  through  the  initial  feasible  vector  until  we  hit  a 
face  of  the  polyhedron,  we  shall  now  proceed  to  describe  the 
method  by  which  we  do  this  and  also  give  the  mathematical 
Justification  for  it: 


Let  us  denote  by  d  the  given  direction  in  which  we  want  to 
travel  starting  from  yQ.  And  let  Ry^  be  the  non- negative 
vector  .  b  -  ^q*/ 

r_Ryo. 

X  ■  -min  --i  ■  a  I  if  for  i  ■  l,***,m  A.d  <  0 
Axd<0  Aia  1  1 


X  -  min 


where  min 


AjdXH  "i 


“O  i  lf  for  some  1  A^d  >  0 


means  we  take  the  smallest  positive 


^0. 

j-g-  for  1  -  1,  •••,«!. 

V/e  will  show  that  the  vector  x  «  yQ  +  Xd  is  a  feasible  vector 
and  for  some  i  we  have  the  condition’  A^x  ■  b^,  which  means 


chat  x 


is  on  the  hyperplane  (we  will  3ay  "face"  for  short) 


defined  by  that  equation. 

Proof.  Ue  first  consider  the  case  when  for  some 


Ry 


0 


■0 


a — r 


then  Ax  «=  A(yQ  +  AyQ  +  ^Ad 


/Ry 


Ax  =*  AyQ  + 


0 


0 


vAi  "d 
\  x0 


Ad 


fBy  \ 

V-  p  \ 

V 

TTS- 

V  0  / 


since  Ry 


n  =  b.  -  A,  y  we  have 
U1Q  X0  X0 


A,  d  »  A,  +  Ryn 

10  0  ui 


A  x  =  A  yQ  +  t  -  A  y 0  «=  t 
"0  0  J  0  0 


thus  showing  for  some  in  A,  x  =  b. 

u  x0  0 


Now  for 


J  /  iQ  wc  have 


I 


o  . 


hence  AjX  <  bj 


R, 


2.  if  A<d  >  0  then 

j  Aja 

Ry0 


^0 

v  0  ,  ir 

1  >  0 


a - 7T-  >  0 

A .  a 
^0 


R^o. 

thus  Ajx  -  Ajy0  +  -j— ^  Ajd  <  Ajy0  +  J  Ajd 

1o  J 


■o 


AJ  <  AJy0  +  -  A  j ;/  0  +  bj  -  Ajy0  -  bj 


Hence  if  Ajd  >  0  for  some  j  we  have  shown  our  claim.  For 
the  case  Ajd  _<  0  for  J  »  l,***,n  we  can  consider  exactly 
the  same  situation  as  above  with  tne  distinction  that  we 
multiply  d  by  -1  and  then  subtract  rather  than  add  Xd. 

This  can  be  done  since  d  is  nothing  but  an  ordered  set  of 
directions  numbers  and  by  multiplying  by  -1  we  have  not  changed 
the  direction  except  for  the  sense  in  wnich  we  were  traveling  on 
the  line  given  by  the  direction  a  and  the  vector  yQ. 


For  the  initialization  of  the  technique  we  give  as  a  direction 
vector  the  normal  to  the  cost  plane,  i.e.,  the  plane  defined  by 
the  linear  cost  function  c.  Vie  do  this  in  order  to  get  an 
"optimal"  start  to  the  method  since  further  directions  are 
going  to  be  defined  by  the  succeeding  approximations  together 
with  tne  given  Initial  feasible  vector  yrQ. 


Before  we  go  into  discus jing  the  experimental  data  obtained  from 
the  method  discussed  above  we  will  describe  a  few  changes  which 


9. 


were  introduced  during  the  cour3e  of  the  experimentation: 


1.  On  page  6  we  defined 

f'-Ry0. 


X  -  -miiu  i  j 
Ajd^l  Aid 


if  for  i  ■  1,  •  •  •  ,m  A^d  <  0 


or 


Ry, 


X  •  min  I  -T--J*  lif  for  some  i  A,d  >  0 

Atd  >  n\Aia  J  1 

We  found  that  if  we  let 

ho\ 

Xi"  and 

fooJ\ 

X2-A>"0  ^  f°r  i_1'"‘,n 


and  define 


X  ■  min  (X..  cd,  X0  cd)  when  k  •  1,2 
Xk  1  * 


then  we  know  that  we  will  not  only  travel  along  the  direction 
given  by  the  d  vector  until  we  hit  a  face  of  the  polyhedron 
but  we  will  minimize  the  cost  in  the  subspace  defined  by  d. 
This  modification  did  not  affect  the  rate  of  convergence  at 
all  among  the  analyzed  problems. 

•  . 

2.  We  recall  that  the  "buckshot"  effect  was  accomplished 
by  generating  a  set  of  "parents"  by  (asexual)  mutations  on  our 
last  best  rector.  These  parents  are  then  mated  in  a  pairwise 
manner.  The  change  we  Introduced  consists  of  allowing  to  skip 
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ahead  the  generation  of  the  parento  and  the  pairwise  mating, 

• 

if  during  the  asexual  mutations  we  found  a  mutant  which  has  an 
improvement  upon  the  running  best  vector  that  is  greater  than  a 
certain  e  we  read  in  as  input  data.  That  is,  if  we  find  a 
mutant  whose  cost  is  smaller  than  the  cost  of  the  last  vector 
minus  e,  then  we  consider  the  mutant  the  best  vecto",  as  if 
we  were  of  the  end  of  a  complete  iteration  and  cortinue  at  the 
beginning  of  the  next  one  by  considering  the  "asexual"  Improvement 
t  the  next  best  vector. 

This  change,  seemingly  minor  in  character  allowed  for  a  tremendous 
upsurge  in  the  time  rate  of  Improvement  --  that  is,  timewise  the 
convergence  was  greatly  accelerated.  Because  Of  this  we  were  able 
to  handle  problems  with  almost  complete  success  which  previously 
were  not  feasible.  Furthermore  in  those  cases  where  the  unmodi¬ 
fied  version  worked  well  there  was  also  an  increase  in  the 
accuracy  of  convergence. 

5-  A  third  change  that  was  suggested,  for  e  buckshot 
effect  was  not  to  "mate"  parents  which  lie  on  the, same  hyperplane. 
That  is,  if  we  let  x  and  z  denote  two  arbitrary  parents  we 
would  not  mate  them  if  for  some  1 

bi  “  Aix  "  0  "  bi  “  Aiz 

This  change  does  not  seem  to  affect  the  experiements  in  any 

*  I 

measurable  way. 


1 


4.  The  last  suggested  change  was  to  move  the  original 
vector  yQ  from  it3  static  location  to  a  more  centralized 
location.  Several  different  methods  were  attempted  none  of  which 
showed  any  improvement  on  preliminary  tests. 
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A  CLASS  OF  LINEAR  PROGRAMMING  PROBLEMS 

Next  we  shall  describe  the  class  of  problems  that  was 
used  for  the  experimentation  in  the  linear  programming  part: 
Let  us  denote  by  I  the  n-dimensional  identity  matrix 


by  J  the  n  x  n  matrix  consisting  of  'l's 


and  by  b  the  n-dimensional  column  vector  consisting  of  l's 


Further,  let  us  define  A  ■  al  +  J  where  a  is  some  positive 
real  number.  The  class  of  constraint  inequalities  was  Ax  >  b, 
with  a  linear  objective  function;  the  cost  function  cx  -  £x^, 
i.e.,  c  «  (1,  •’••,!),  the  n-dimensional  row  vector  consisting 
#  of  ones. 

The  main  advantage  in  using  these  constraints  lies  in  their 
handling  sase,  as  will  be  obviouB  in  the  sequel.  The  original 
suggestion  to  U3e  these  matrices  came  from  Hooke  and  Jeeves, 
[15  ],  who  developed  an  interesting  search  technique  for 

the  solut  .on  of  linear  equations. 


By  the  condition  number  of  a  matrix  we  understand  the  ratio 
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rf  the  largest  to  the  smallest  eigen  value  of  the  matrix.  To 

find  the  eigen  values  of  ai  +  J  we  note  that 

lal  +  J  -  XI  I  -  I (a  -  X)l  +  J  I  where  the  subscript  n  is 
1  n  n  n  v  '  n  n 

used  to  denote  the  dimensionality  of  the  determinants. 


l(a-X)In  +  Jn| 


n 


(a-X)  +  1 . 1 

1  (a-X)  +1  1.  ...  1 

•  • 

i . (a-X)  +  1 
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Hence  the  eigen  values  are  a,  n-1  times,  and  a+n  once.  The 
condition  number  is  thus  found  to  be  c  -  which  can  be 


IK 

| 

readily  changed  by  manipulating  a.  The  solution  of  the  problem 
is  x  -  A  Xb  -  f^I  -  a^+a)  Jj  b* 

We  shall  first  report  the  experiments  that  were  carried  out  with 
the  original  method  described  on  page  5  and  thereafter  v/e  will 
discuss  the  effect  of  the  modifications  described  on  page  9  • 

Rather  than  discussing  all  the  problems  that  we  experi¬ 
mented  with  we  shall  discuss  two  typical  examples  and  only  on 
occasion  comment  on  others  as  the  need  arises. 

For  the  five  dimensional  case,  i.e.,  n  ■  m  ■  5,  and  v/ith 
a  condition  number  of  5  we  observed  that  the  method  converges. 

The  convergence,  however,  is  3trongly  dependent  on  the  value  of 
the  dimensions  of  the  cone  of  the  buckshot  effect.  For  example, 
if  we  start  with  an  fh  -  2.0  and  an  f^  ■  0.08,  where  fh  and 
are  the  high  nd  low  arguments  respectively,  the  method 
Iterates  11  times  and  then  finds  no  improvement  among  the  buckshot, 
i.e.,  x  ■  x' .  The  result  remained,  after  11  iterations  with  a 
maximum  error  of  1/10.  The  same  problem  run  with  f^  ■  1.0  and 
f^  -0.1  converged  beyond  the  point  where  the  small  component 
factor  started  to  be  modified. 

For  the  analogous  problem  with  n  -  n  -  5  but  with  a 
condition  number  of  1.19  we  find  the  same  behavior  except  that 
the  error  for  this  case  came  out  to  be  1/1000  after  20 
iterations. 

It  is  interesting  to  note  that  this  problem  also  crops  up 
when  we  deal  with  higher  dimensional  cases.  We  want  to  note 

i 

that  the  same  problem  of  cones  that  are  too  large  for  the  buckshot 
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effect  was  dramatized  In  the  case  for  n  «  30  *  m  with  a 
condition  number  of  2,  when  after  57  Iterations  we  terminated 
the  execution  since  no  Improvement  was  found  In  the  family 
generated  by  fh  and  f^.  They  were  fh  -  1  and  f^  -  0.1. 
This  leads  one  to  speculate  that  the  perturbation  factors 
fh  and  f^  may  be  Inversely  related  to  the  dimension  of 
the  system. 

Returning  now  to  our  discussion  of  the  5-dimensional 
case  we  would  like  to  discuss  the  effect  of  changing  the 
original  feasible  vector  In  such  a  way  that  It  is  no  longer 
so  "neatly"  centralized.  We  noted  that  although  the  method 
empirically  converges  its  rate  of  convergence  is  slower, 
namely  when: 

yQ  ■  (2.5,  9,  5*5,  3  1*0  as  opposed  to 
y0  -  (3.5,  2,  A,  3,  5) 


In  15  Iterations  the  largest  error  was  2/100  whereas  the 
largest  error  at  the  end  of  20  iterations  of  centralized  yQ 
was  1/1000. 

•  As  the  method  was  originally  programmed  for  a  computer  It 

was  not  practical  for  larger  systems  at  all,  hence  we  introduced 

a  modification  which  would  make  the  buckshot  family  smaller. 

We  recall  that  by  making  2  large  and  2  small  perturbations  for 

each  coordinate  direction  we  have  that  the  number  of  vectors  in 

the  "parent"  set  is  An.  We  then  proceeded  to  pairwise  mate 

this  set,  including  also  the  best  running  approximation  we  thus 
■n+l\  2 

>  2n(An+l)  ■  8n  +  2n.  For  n  ■  100  this  makes 

\  2  / 
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the  family  have  80288  vectors.  To  generate  such  a  large  family 
is  infeasible  because  of  time  considerations.  We  should  mention 
that  when  we  tried  the  full-blown  scheme  explained  above  for 
n  »  30  it  took  35  minutes  on  the  IBX  7 0 9 ^  to  iterate  Just  9 
times.  The  way  we  have  gotten  aroi  nd-  this  difficulty  is  by 
skipping  over  a  goodly  number  of  the  parents  in  our  mating. 

When  this  was  done,  the  time  was  considerably  reduced  but  the 
rate  of  convergence  per  major  cycle  for  those  experiments  tried, 
was  not  reduced  in  any  marked  way.  For  example,  for  n  »  5 
we  tried  skipping  over  every  2  "parents".  The  number  in  the 
total  family  was  reduced  oy  a  factor  of  k  and  the  rate  of 
convergence  was  not  modified  at  all.  In  higher  dimensions, 
for  the  casei  tried,  this  accelerated  the  convergence  rate. 

For  one  particular  run  on  the  5-dimensional  case  we  also 
set  up  a  problem  where  we  had  more  constraints  than  variables. 

In  this  problem  again  the  method  empirically  converged.  The 
case  we  tried  is: 


and  cx»x,+xn  +  x-,  +  x,+xI- 

The  estimated  solution  vector  converged  to 

x  “  (1,  -23,  1,  -23,  -2^)  after  15  iterations. 
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As  we  mentioned  above  we  also  tried  some  higher  dimensional 
cases.  A  9-dimensional  problem  converged  to  the  answer  with  a 
maximum  error  of  2.5/1000  in  30  Iterations.  We  ran  a 
30-dimensional  case  that  had  to  be  stopped  as  r.  failure  after 
ii6  iterations.  This  took  about  seven  minutes.  Zf  we  extrapolate 
from  our  analysis  of  smaller  dimensional  cases  the  convergence 
seemed  to  be  on  the  right  track  and,  apparently  the  size  of 
the  cone  was  too  large  in  our  buckshot  effect. 

Let  us  now  Investigate  the  consequences  of  the  changes 
introduced  on  page  9  by  comparing  the  results  of  identical  runs 
with  the  modified  and  unmodified  versions  of  our  method.  We 
want  to  note  that  the  modification  was  Introduced  In  such  a 
manner  that  It  was  possible  to  use  the  same  program  for  both 
versions  by  simply  changing  an  Input  constant  t.  To  accept 

*  or  reject  "asexual"  improvements  depends  on  this  t  which 
when  large  enough  would  reject  all  "asexual"  improvements.  We 
want  to  note  that  the  method  was  somewhat  streamlined  by  more 
efficient  programming.  This  helped  in  reducing  running  time, 
as  can  be  observed  by  the  time  estimates. 

To  begin  with,  we  will  start  with  the  5-dimensional 
case,  which  is  the  one  most  extensively  investigated: 

•  ?or  a  condition  number  of  2.25  the  old  version  ran  for  3*6 
seconds  and  6  loops  to  stop  with  a  maximum  error  or  0.1128. 

This  error  seems  largely  due  to  the  large  cone  factor  for  the 
buckshot  effect.  The  modified  version,  however,  ran  for  10.8 
seconds  and  17  loops  to  stop  with  a  maximum  error  of  0.00026. 

The  maximum  error  after  6  loops  in  the  second  run  was  0.0587; 


Next  let  us  consider  the  cases  for  a  condition  number  of 
5.07.  With  a  large  cone  factor  the  unmodified  version  in  4.8 
seconds  looped  6  times  and  terminated  with  a  maximum  error  of 
0.009971;  its  associate  looped  10  times  in  7.2  seconds  and 
terminated  with  an  error  of  0.000045.  • 

By  changing  the  constant  which  limits  the  asexual  improve¬ 
ments  also  note  some  change  in  the  rate  of  convergence  to  the 
solution.  For  example,  by  letting  t  ■0.1,  the  high  cone 
factor  f^  ■  2.,  and  the  small  cone  factor  fj  ■  0.1,  we 
obtained  in  1.8  seconds  4  loops  with  an  error  of  0.067.  By 
changing  ?  ■  0.01  and  the  high  cone  factor  to  1,  we  Iterate 
10  times  for  4.8  seconds  with  a  maximum  error  of  0.000035*  By 
further  reducing  t  to  zero  in  3  seconds  we  Iterate  6  times 
and  terminate  with  an  error  0.000021  --  in  this  last  run  the 
high  cone  factor  was  2.0.  Now  when  we  changed  the  cone  factor 
to  1  we  found  that  we  terminate  in  the  second  loop  with  a 
maximum  error  of  0.017.  This  pattern,  continues  when  we  change 
the  condition  numbers  of  the  matrices  we  experiment  with. 
However  for  one  case  with  a  condition  number  of  10  we  find 
that  with  a  high  cone  factor  of  1  the  unmodified  version  in 
6.6  seconds  loops  11  times  and  terminates  with  a  maximum  error 
of  0.000256.  With  a  t  of  0.01  we  Iterate  for  10.2  seconds 
and  16  loops  to  end  with  an  error  of  0.006666,  and  for  t  -  0 
in  2.4  seconds  and  3  loops  we  find  a  maximum  error  of  0.0014461 

*  1 

With  a  different  set  of  random  numbers,  however,  the  above 
described  problem  ran  4.8  seconds  and  7  loops  with  a  maximum 
error  of  0.000014.  The  same  pattern  continues  for  condition 
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numbers  of  15  and  21.  We  refer  to  the  summary  table  2  at  the 
end  of  this  discussion  for  a  global  picture  of  all  the  runs 
we  made  for  the  5  dimensional  problem. 

Let  us  now  Investigate  the  9  dimensional  problems  we 
experimented  with.  For  a  condition  number  of  2.25  we  found 
that : 

If  we  let  the  cone  factor  be  0.1  the  old  version  Iterates  In  one 
minute  and  55*8  seconds  77  times  and  terminated  with  an  error  of 
0.044760.  When  the  new  version  was  us6d,  with  an  asexual 
Improvement  t  of  0.01  we  find  that  In  32.4  seconds  and  13  loops 
the  maximum  terminal  error  Is  0.017109.  When  we  used  a  cone 
factor  of  2  and  t  -  .01  we  find  that  In  10  Iterations  that 
took  25.8  seconds  the  error  is  0.036451.  By  deducing  to 
t  -  0  we  have  In  7  Iterations  and  22.2  seconds  a  maximum 
error  of  0.000044,  with  a  large  cone  factor  of  0.1.  For 
higher  condition  numbers  we  experimented  with  a  ten  dimensional 
case,  viz.,  we  considered  a  condition  number  of  5.  When  the  high 
cone  factor  was  2  and  we  used  the  older  version  we  find  that  In 
26  Iterations  and  2  minutes  we  achieved  a  maximum  error  of 
C. 045106.  When  we  permitted  o..  exuai  Improvements  of  0.01  we 
find  that  the  process  Is  terminated  In  41.4  seconds  and  8  loops 
with  an  error  of  0.010270.  When  we  had  a  cone  factor  of  1.0  we 
Iterate  22  times  In  92.4  seconds  and  terminate  with  an  error  of 
0.002213.  When  we  tx*y  to  reduce  the  family  size  by  16  we  find 
that  the  same  problem  as  above  finds  iio  Improvements  after  4.2 
seconds  and  2  loops  and  terminates  with  a  maximum  error  of 
0.1343^3*'  It  Is  worth  mentioning  that  the  preceding  experiment 


Table  1,  page  25,  summarizes  our  original  results  with 
the  unmodified  version.  Table  2,  pages  26  through  28,  summarizes 
the  comparison  of  the  two  methods.  The  flow  chart  which  follows 
the  tables  corresponds  to  the  modified  piogram.  We  did  not 
include  the  flow  chart  of  the  unmodified  version  because  we  do 
not  believe  that  the  addition  would  add  any  valuable  information. 
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convex  pkcqtikkino 

The  method  iva  discussed  in  the  .linear  programming  part  v;a3 
extended  in  a  "natural"  way  to  try  to  solve  convex  programming 
problems.  By  convex  programming  v/e  mean:  given  a  convex  set 
(whose  constraints  or  boundaries  are  not  necessarily  defined  by 
linear  functions),  and  a  linear  co3t  function,  we  want  to  find 
a  point  in  the  convex  set  such  that  no  other  point  in  it  has  a 
smaller  cost.  If  the  constraints  are  linear  the  problem  reduces 
to  linear  programming.  V/e  note  that  the  linearity  of  the 
constraints  in  the  linear  programming  method  was  used  exclusively 
for  finding  the  intersection  of  a  given  line  with  the  boundary, 
and  nowhere  else.  Thus  this  method  becomes  suitable  for 
generalization  as  soon  as  we  have  a  way  of  finding  the  inter¬ 
section  point  of  a  line  with  the  boundary  of  the  convex  set. 

Let  us  now  analyze  the  method  that  v;e  used  to  find  the  point 
on  the  boundary  given  by  the  intersection  of  the  constraint 
surface  and  a  line  defined  by  a  vector  of  direction  numbers  and 
a  point  through  which  the  line  must  go; 

The  equation  of  a  line  through  a  point  y  with  given 
direction  numbers  &  ■  (d^, • • •,£  )  is  given  by 

x  -  (x1#  •••,xn)  -  (yx+  td1#  y2+  td2,  tdn)  or  simply 

*  - 

x  -  y  +  to. 

If  we  define  our  convex  set  a3  the  intersection  of  several 
convex  sets  given  by  the  following  equations: 

^(x)  ^  b^,  i  -1,  ••*,  m,  where  9(:c)  are  continuous  functions. 
Then  we  can  simply  say  that  we  want  to  find  a  X  such  that: 

*  Note:  The  general  convex  programming  case  admits  a  convex 
.  objective  function. 


yj 


o,.  (y  +  Xu)  <_  b^  Tor  i  *»  1,  m  and  Tor  some  j 

s’,(y  +  Xa)  -  b1 . 

Since  the  convex  sets  arc  bounded  wo  can  say  that  Tor  a 
given  t  >  1  we  can  find  an  n  such  that 


9j(y  +  tnd)  >  b,  for  some  j  and 

9i(y  +  t“~^&)  _<  b^^  for  i  ■  1,  •  ••,  m  since  y  is  inside 
the  convex  set.  We  now  proceed  by  fixing  jt|  >  1,  then  we 
can  find  n  by  multiplying  t  by  |t|  until  we  find  the  desired 
n-  We  then  know  that  tn-‘t  _<*a  <  tn,  the  order  may  be  reversed 
if  t  <  0.  We  can  then  by  trial  and  error  find  X  by  a 
binary  search  within  the  interval.  If  we  lot  t  >  0  denote  a- 
tolerance  which  we  lixed  before  wo  start  our  search  for  X  we 
car.  continue  as  follows:  For  notational  simplicity  let  U3 
assume  t  >  0. 


Let  a  =  tn-tn_1  and  3  -  tr_1, 


I-  ^(y  +  (3  +  ia)n)  <  b^ 


;or 


i  ■  1,  m,  and  for  some  J,  -  Pj(y  +  (3  +  ia)ci)  <  t 

then  we  define  X  ■  3  +  -^a.  If  for  i  *  1,  m 

b,  -  Pi(y  +  (3  +  >  t  then  let  us  replace  3  +  for  3 

and  -go-  for  a  and  contirue.  If  p_.  (y  +  (3  +  tjC)c)  >  b,  then 
we-  replace  3  -  for  3  and  i  a  for  a  and  continue.  This 
method  converges  because  the  constraint  surfaces  are  continuous. 


In  this  manner  we  find  the  point  x  which  lies  on  the  line 
with  direction  numbers  cl  through  y  within  t  of  at  least 


one  constraint  surface 


Since  In  our  method  we  arc  searching  within  a  small  cone 
of  a  Given  beat  vector  v:e  know  ihf.t  subsequent  X's  us  not 
differ  by  very  much,  in  General,  and  are  good  approximations  to 
each  other.  However,  even  If  tne  approximations  were  not  Good 
we  have  a  convergence  for  start irg  |h|  >  1  at  the  beginning  of 
each  cycle,  end  this  is  easily  guarantees.  For  a  precise 
description  of  the  method  we  refer  the  reader  to  the  flow 
chart  at  the  end  of  this  section,  p.  51, 


A  CLASS  OF  CONVEX  PROGRAMMING  PROBLEMS 


As  convex  seta  we  used  the  n-dimenslonal  ellipsoids 
defined  by 

n  x.-a.  4  2 

y.  (x,,“-,x  )  =  2  (A--  <  e  ,  where  1-1,  •••,  m, 

1  1  J-l  1J  1 

and  m,  n  <  10. 


This  family  was  chosen  fur  expediency  reasons  since  any 

such  function  is  easily  evaluated  and  therefore  fast  or.  the 

computer.  The  answers  are  also  readily  checked  for  the  case 

m  *»  1,  as  will  be  established  in  the  sequel.  For  m  >  1  the 

problem  is  more  complicated  because  the  answer  may  '  le  on  the 
« 

curve  defined  by  the  intersection  of  the  m  ellipsoids.  However, 

the  main  reason  for  using  m  -  1  in  our  experiments  was  that 

m  is  a  factor  of  the  length  of  time  the  computer  takes  in 

doing  a  particular  example.  This  can  be  readily  verified  since 

we  spend  mo^s  of  our  machine  time  in  finding  the  Intersection  of 

a  line  and  the  surface  bounding  the  set,  and  there  are  m  of 

these  equations  to  evaluate  each  time.  Furthermore,  it  seems 

reasonable  to  assume  that  if  the  method  can  solve  problems  for 

m  a  1  then  it  can  also  solve  them  for  m  >  1. 

V.’e  are  given  together  with  the  ellipsoid 
n  x.-a..  2 

2  (-4 - -)  <  e,  a  linear  cost  function 

J-l  U 


a 

c 


Jk 

X 


n 


2  c.x.  which  we  are  to  minimize.  The  answer  to 
J-l  J  J 

the  problem  then  is:  for  m  -  1,  the  point  of  tangency  at  the 


r 


ellipsoid  such  that  the  tangent  hyperplane  has  the  direction 

numbers  given  by  c  -  (c^,***,  _n),  and  such  that  the 
n 

2  c.x.  is  the  smaller  of  the  two  possible  outcomes. 

J-l  J  J 

Without  loss  of  generalization  we  can  assume  that 

n  x.-a.  x  2 

2  (-'£ — *-)  <  e  can  be  reduced  to  ^(r-1)  <  e,  by  simply 

J-l  J  “  J  “ 

translating  the  ellipsoid.  Since  we  are  interested  only  in 

the  boundary  point  we  have 

n  x .  2 
2  (^)  -  e . 

J-l  LJ 


Prom  elementary  calculus  we  have  that  the  tangent  plane  at 

*n  x.z. 

a  point  z  can  be  represented  by:  2  -n *  -  e.  And  this  plane 

n  J"1  bj 

is  to  be  parallel  to  2  c.x.,  consequently  we  have 

J-l  J  J 
z 

t  -4J)  -  X(c1#  c2,  cn)  that  is  the  direction 

bn 

2 

numbers  are  proportional.  Hence  we  have  z^  -  X  b^  c^. 
Substituting  in  the  equation  for  the  ellipse  we  have: 


n 

2 

i-1 


,2,2  2 
X  bici 


n 

e/(  2 
1-1 


cl> 


and  X 


-  W(  2 
1  1-1 


n  2n 

blcl)  . 


-i 


Since  for  our  experimentation  we  chose  c  such  that  ci  0 
and  at  least  one  c^  >  0,  we  could  always  solve  for  two  real 
distinct  X ' 8 .  From  these  we  can  always  pick  the  X  which 
gives  us  the  smallest  cost  when  we  substitute  for  the  answer, 
we  denote  by  a  the  center  of  the  ellipse  then  the  answer  is 


If 


^  a  2  2  2 

x  =  a  t  X(b1c1,  b2c2'  ’  *  * '  t)ncn^  ‘  Note  that  this  expression  is 
readixy  computable. 


Another  Important  aspect  that  aided  U3  in  the  choice  of 
these  functions  was  the  ease  with  which  one  can  make  changes 
in  the  format  of  the  ellipsoid  by  simply  changing  the  coefficients. 
V.'e  can  make  the  convex  set  be  an  elongated  "cigar"  in  which  the 
search  would  be  more  difficult,  if  we  make  the  ratio  of  length  to 
width  large  enough.  This  problem  wa3  suggested  by  Bremermann 

I 

and  Salaff  [7]. 


The  program  that  we  ran  on  the  15 K  7094  was  written  in 
Fortran  and  FAP .  Its  structure  is  in  general  the  same  as  the 
modified  version  of  the  linear  programming  problems.  That  is 
to  say  v;e  built  into  the  program  the  capacities  we  found 
advantageous  in  our  previous  expe rinent? .  The  program  allows 
"asexual"  improvements  during  the  "  arent"  generation  stage. 
For  a  detailed  view  of  the  process  we  refer  the  reader  to  the 
flow  charts  at  the  end  of  this  section,  pp.  49  to  $1. 

Most  of  the  experiments  we  ran  were  with  ellipsoids  whose 
coefficients  were  rather  well  behaved,  that  is,  in  a  range 
between  1  and  10.  The  experiments  were  geared  mostly  to  find 
out  how  tne  method  behaves  as  we  let  n  grow  from  2  to  10. 

V.’e  begin  by  analyzing  one  of  the  simplest  experiments 


possible : 

(ii)2  +  (^5)2  <  i 


with  a  cost  function  ■  z 


x  +  y  to  be  minimized.  The  point 


cf  departure  was  yQ  -  (5,5)  which  Is  within  the  ellipse 


i 


t.  *  i »,ioh 
I,  •  (*.«M  ,  »5oO 
(*.<»T  ,  *.»tO 

AwmK  i  < 


In  this  case  we  can  see  that  given  a  very  propiclous  start  the 
progress  is  as  one  would  expect  it:  direct  and  fast.  This 
particular  run  took  2  loops  and  1.2  seconds.  P'ost  of  It, 
however,  is  spent  on  the  input  and  output  of  information.  We 

_7 

note  that  x  cones  to  within  2.57  X  10  of  the  ellipse.  If 
we  now  do  the  same  problem  but  3tart  with  a  Yq  of  (7-5>  4.5), 
our  progress  is  a  bit  slower  ,  the  sequence  of  best  vectors 
being: 

X0  -  (5-55?,  3.024),  Xl  -  (4.495/  3.27),  Xj  -  (3-504,  3.891). 

1 

Between  these  vectors  a  great  many  more  asexual  improvements 
come  to  span  the  Xq,  x^,  x^. 


For  the  former  case  we  only 


>9 


have  2  asexual  Improvements;  for  the  latter  we  have  20.  It 
is  notewortb'  that  the  latter  also  took  2.4  seconds  to  converge 
to  approximately  the  same  answer. 

Let  U3  now  consider  a  case  which  Is  an  "elongated  cigar 
shaped"  ellipse: 


( 


x-10> 


2 


/V-0.1 

'  “073“ 


2 

) 


<  1. 


Luis  defines  an  ellipse  of  length  100  unit3  and  width  of  1. 

« 

The  starting  point  we  took  was  (19,0.09).  For  a  cost  function 
of  c  a  (10,1)  the  sequence  of  test  vectors  was: 

xc  ~  (17.05,  0.05806),  x]_  -  (0.1712,  0.08157 ),  x2  -  (O.loll,  O.OQ; 

x^  =  (0.01561,  0.09442),  x^  o  (0.01486,  0.09455). 

The  answer  to  the  problem  Is  (0.1  x  10-^,  0.09999).  This  run 
took  7.2  seconds.  Vfnen  we  changed  the  large  cone  factor  from 
1.2  to  0.8  our  method  fared  much  better.  For  In  the  sixth  loop 
the  answer  was  xf-  -*  (C.42  x  10”^,  0.09995).  This  result  Is 
in  line  with  our  previous  experiments  In  linear  programming, 
where  we  found  that  a  smaller  cone  factor  led  in  general  to  a 
better  approximation  at  the  expense  of  a  greater  number  of 
iterations.  The  latter  case  took  5  seconds.  In  a  subsequent 
run  we  changed  the  cost,  function  to  make  for  a  les3  well  defined 
point  of  tangency.  We  let  c  -  (1,10).  The  method  converges 
as  follows: 

xQ  -  (16.52,  0.04452),  x1  -  (.1849,  0.08086),  X2  -  (.1779,  0.08122). 
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The  answer  is  x  -  (0.04S3,  0.0005).  At  this  point  we  should 
note  that  the  method  does  not  behave  very  well  when  the  tangent 
to  the  curve  makes  a  very  small  angle  with  the  line  at  the 
intersection  defining  the  points  on  the  curve.  This  is  due  to 
the  constants  used  in  the  convergence  to  the'  point  of  inter¬ 
section  and  also  partly  due  to  the  limitations  of  the  floating 

I 

point  arithmetic  of  the  computer.  Although  this  problem  is 
surmountable  we  did  not  endeavor  to  conquer  It,  the  Interest 
being  marginal. 

Let  us  now . investigate  a  typical  3-dimensional  experiment 

_<  1  with  a  cost  function 

c  =  (1,1,1),  a  cone  factor  of  1.2  and  art  initial  feasible 
vector  Yq  •*  (5*5*4).  To  iterate  twice  the  method  took 
6  seconds  and  converged  to  Xj  ■  (4.339*  4.262,  2.014),  the 
correct  answer  being  x  ■  (4.31*  4.255,  2.02).  When  we 
changed  the  cost  plane  to  c  ■»  (1,2,3)  we  converged  in  7.2 
seconds  to  x^  -  (5-318,  4.373*  1-312),  x  »  (5-29*  4.368,  1.21). 

If  we  took  a  long  cigar  in  three  dimensions  we  faced  the 
same  sort  of  problem  that  we  had  in  the  2-dimensional  case. 

For  example  let  us  look  at  the  following: 

(^§2)  +  (^ot i~)  +  )  i  1  wlth  a  C03t  plane 

c  *»  (10,1,1)  and  an  Initial  feasible  vector  yQ  «  (15*  0.09*  0. 
For  this  case  we  stopped  after  58.8  seconds  at  x^  -  (0.0008714 
0.1003,  0.09911)-  The  true  answer  is  x  ■  (0.1x10’^,  0.09995*  0 


09). 

I 

-09995 


0 


l 


4 


i 


t 


*5). 


jet  us  now  analyze  a  six  dimensional  example: 


x,  - 4  2  x0-4  2 

(-V-)  +  (-S-) 


x,-4  2  Xu -4  2  Xq - 4  2  X/--4  2 

( — r-)  +  ( — it-)  +  (—? — )  +  ( — 5”)  <.  1 


with  a  cost  function  c  =  (1, 1, 1, 1, 1, 1)  and  -  (4, 4,4, 4, 4, 4) . 
In  l6.2  seconds  the  program  iterated  twice  and  converged  to 
x.  =  (3-453,  2.318,  1.562,  1.912,  2.799,  3-444)  the  true  answer 
hire:  x  -  (3-475,  2.82,  1 . 89,  I.89,  2.32,  3-475)-  This 
^y.yiT  .mens  was  relatively  trivial  since  we  started  out  from  the 
cente  cf  the  ellipse.  However,  when  we  tried  the  following 
10-dinensional  case: 


2  ^2  ,,  2 
Xp-3  x,-4 

■)  +  (.4-)  +  (  3 


2  2 
x„-2  *  X/r-2  * 


T" - )  +  ("” J — )  +  (  “)  +  (— -y ) 


2  2  2  2 
x7-4  Xo-3  xr-4  *  x,  n-2 

Hr—)  +  (-§—)  +  (-? — •)  +  (—^11 — )  <  1  wlth  a  cost 


2  '2  '  4  '  '4 

function  c  «=»  (1 , 2, 2 , 5,  2 , 4, 1 ,2, 2, 5)  and 


rr  ci 

•'O 


(4,3,  3-2,  4.4,  5.3,  3.3,  2.3,  4.3,  3-2,  4.4,  2.4). 


The  method  iterated  5  times  In  91-2  seconds  and  stopped  at: 

x5  -  (3.593,2.664,2.698,3.931,2.297,0.4893,3.631,2.672, 

2.675,  -0. 04223)  compared  to  the  true  solution 

x  =  (3.627,2. 669, 2 . 67 5 , 3  -  882 , 2 . 2 55, 0 . 507 , 3  -  627 , 2 . 669, 2 . 67 5, 0 . 01 ) 


Eefore  we  summarize  our  results  let  us  discuss  one  two-dimensional 
intersection  of  two  ellipses  which  we  ran. 

2  _  2 


+  e?)  <  1 

l£h)2  +  <4^)2  <  1 
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With  a  cost  function  c  ■  (1,1)  and  a  start  yQ  -  (6.5,5) 

In  two  loops  It  converged  to  (3*209,  3*222).  We  note  that 
this  point  Is  within  0.0936  from  the  boundary  of  the  first 
ellipse  ana  0.0077  from  the  second  one.  That  Is  to  say,  It 
Is  approximately  at  the  intersection  where  it  should  be. 

In  view  of  our  experiments  we  find  that  what  would  be 
expected  from  the  consequences  of  the  more  widely  experimented 
linear  programming  would  also  hold. true  in  the  convex 
programming  case.  Namely,  we  would  expect  that  the  smaller 
the  cone  for  the  "buckshot"  the  better  the  approximation  and 
the  lengthier  the  procebo.  -This  leads  us  to  believe  that  the 
method  has  not  been  tested  widely  enough,  and,  ev^n  where  tested, 
not  all  the  features  that  the  experiments  suggest  were 
implemented.  For  example,  if  one  wants  to  develop  an  efficient 


algorithm 

based  on  this  approach 

on 

should 

Investigate  the 

possibilit 

y  of  a  "seif  organ! zir 

cone . 

That  is,  the  dimen- 

sions  of  the  cone  would  be  based  on  some  possibly  gross  estimat 
ion  of  what  the  surface  "looks"  like  in  the  neighborhood  of  a 
given  best  point.  This  suggests  ,  elf  if  we  consider  the 
following  case 

'«■  i 

I 


) 

I 


I 
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if  we  make  even  a  small  change  In  coordinates  at  x  and  draw 
a  line  x  +  5  e  then  we  see  the  angle  a  is  snail  but  the 
effect  is  the  same  as  for  a  much  larger  &/  from  a  different 
point  y'.  This  also  points  to  the  need  of  moving  the  initial 
feasible  vector  to  more  favorable  spots  in  the  convex  3et. 

In  spite  of  some  shortcomings  of  the  program,  3ome 
results  are  very  encouraging.  Even  the  poor  convergence  in 
ellipsoids  whose  ratio  of  largest  to  smallest  diameter  i3 
large  we  find  encouragement,  for  if  we  suitably  modify  the 
basic  feasible  vector  we  think  that  the  method  can  become 
more  accurate. 

If  by  convex  set  we  understand  a  set  such  that  given  two 
points  in  it  the  line  segment  Joining  them  is  also  contained  by 
the  set,  then  we  want  to  note  that  in  our  discussion  we  used 
this  property  only  very  superficially.  What  we  used  mo3t  was 
our  assumption  that  the  giver,  sets  were  bounded,  and  this  only 
in  the  direction  toward  the  <-  sat  plane,  and  closed,  that  is  we 
could  find  the  point  on  the  boundary.  From  this  we  thought  that 
another  possible  application  would  be  to  use  a  modified  technique 
for  finding  roots  of  polynomials,  around  a  local  "guess",  in 
the  complex  plane.  This  seems  a  feasible  proposition  since 
polynomials  are  easy  to  evaluate  on  the  computer.  If  the 
constraint  functions  are  difficult  to  evaluate  or  take  a  long 
time  to  be  computed,  then  the  method  might  break  down  from  the 
point  of  view  of  t:me  elapsed  to  find  the  answer,  for  the  main 
part  the  program  loops  in  evaluating  the  constraint  functions. 

The  following,  table  has  a  summary  of  all  our  experiments. 
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